Statistical Performance Comparisons of Computers

Precise Computer Performance Comparisons Via Statistical Resampling Methods

Performance variability, stemming from nondeterministic hardware and software behaviors or deterministic behaviors such as measurement bias, is a well-known phenomenon of computer systems which increases the difficulty of comparing computer performance metrics. Conventional methods use various measures (such as geometric mean) to quantify the performance of different benchmarks to compare compu...

Statistical Analysis of Interlaboratory Comparisons

This workshop is being hosted by NPL as part of the Software Support for Metrology (SSfM) programme that it operates for the UK Department of Trade and Industry as part of the National Measurement System (NMS). SSfM is a metrology-focused programme designed to identify and disseminate best practice in the use of mathematics, statistics and software throughout the NMS. It concentrates on generic...

Statistical Comparisons of Multiple Classifiers

Statistical Simulations on Parallel Computers

The potential benefits of parallel computing for time-consuming statistical applications are well known, but have not been widely realized in practice, perhaps in part due to associated technical obstacles. This article develops a simple framework for programming statistical simulations using parallel processing, which does not require changing programming language or forgoing the use of standa...

Evaluating high-performance computers

Comparisons of high-performance computers based on their peak floating point performance are common but seldom useful when comparing performance on real workloads. Factors that influence sustained performance extend beyond a system’s floating-point units, and real applications exercise machines in complex and diverse ways. Even when it is possible to compare systems based on their performance, ...